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(54) METHOD AND APPARATUS FOR PROVIDING USER SELECTED ADVANCED CLOSED 
CAPTIONS 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a closed caption 
function which is advanced through the use of existing 
closed caption infomnation which is carried in a TV signal 
in a closed caption producing apparatus. 
SOLUTION: A user is permitted to neglect a closed 
caption expression format which is selected by a 
producer (e.g. a programmer or a broadcaster) in order 
to select another expression attribute based on the 
taste of the user concerning user customizable 
advanced closed caption performance. Besides, another 
form of text information (e.g. subtitles) is customized so 
as to consider preservation, continuous retrieval and 
review. The provided method and apparatus are 
independent of the type of a distribution network, a 
contents format and a receiver type. 
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lAErHO^ A}ID iiPfdlAniS for TSE rSOVISlO!^ of USlS SeUCrCD ADViNCED CIO 
SCO CAFT(OHS 
I ClaiDS 

1. A meCbod &r jmvisioo of user selected advanced dbsed capdons, eooopnsmg ft6 

exiractiDj cloeed Qdp^ iafbrmsdon ftosn atclcnrioQ sigiml tuKviog 
coiropoQdtngtJsieviticii ptogjMMXBgi 

detenninlng whether one or more user sele cted aUribosee have beon&ct; 

applying at least one ^aer eeieeted attritmie to at least a portion of ifae dosed 
captioo mfbimatioa; and 

displaying die closed capdoa tnAmnadon oa a £)fpiay device in aooocdawe with 
I3ie user seleeied attribuses via a gFaptuca] emrlay on top of die television programming. 

2. A iDCfbod fai aocofdanoe mibdalm 1^ wtwrem: 

die CnbriffjoQ signal is laceivedt deanoduiaiad^ stiddeacianibkd prior lo said 
extiaodng said dosed eag)tian ta fen i wtiwL 

3. A meibod m aocoinianoe vdlh daim 1 or 2» wbaraio the user selected advaneed dosed 
c^iOfloi attributes are applied to closed caption in&rmation received via one of a 
ddiviny netwoifc, a persoaal vanadle reeofder (PVRX a sec-top tBmuD&l, a d^sTtat 
tdevisioQ, a persons! computer, a video casselte.reooider, a digitd video recorder, os a 
digisal video disk player. 

4. A imUkodifi aocoidence witli one of claims 1 to X wherein the provision of user 
selected advanced closed captions occurs at one of a peiaoiial vmatite reconier (PVR), 
a set-^ terminal a ^gital tdevisionp a personal computer, a digital video recorder, or a 
digital video diric player. 

5. A nDuediod in accordance with one of claims 1 to 4, v^hei^ 

cnmprisa at least ona of font size, font type» foot cotor» eapdoa window posidon, caption 
vm^dow ai2e>prfsl diiecttoo^scFdl direction, scsoUrate. text opacity, back^und 
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opacity, nt justification kft; tcxt^ielificaHon rigbt» t«ct justificadoii ceoter, out 
background cotor* 

6. A i&i0tbdd to aoc<ml«ice with cno of claii2i8 1 to 5« 

the cioBdd cBption iofiNmatton u 

7. A method i& accordance with dam ^ v^mn midtipk closed caption boxes m 
^Bsplayed ahmfltsMOudy. 

8. AinebodinaoooKdancewitliiomofclaiiiia llo7| wheicin: 

the ciowd coptioa infiwcutioiD ia taggad wib aa ideotUier Hutt distiagoidica it 
froni talovision p9x>grfliiiitniAg d^ta; and 

the cimod coition ii^&tmation ia exsracfed baaed on ibcidcnciiS^aT. 

9. A tneibod io acoordance with ono of plauna 1 to 8, whareio: 

dia televiaion aignal ooxoprisea eo MP£0>-2 tnnspoit atraam; 
d)e closed cf^tion ioftmaiiM ia canie^ 

die dosed caption iDfiannation is ttcbaciad based os dieuaar data fl^ 

10. A metiMKl in accordance wt^h erne of claims 1 to 9, Vfteiain aaid ctosod captioo 
tafbnnation compsiaes one of BIA*60E closed caption bfeonation ot fiIA*708 dosod 
caption infonn^ioo. 

1 1 < A mediod in aoooidasce with odo of daints 1 to 1Q» whemn die t^ser selected 
attiibttlesaroensered via at least one cifapop-iqpm adlatoguBbax^ andoptiO-down 
wtedow mcniL 

12. A niedK>dio accordance with one of claims 1 Io il« farther con^rising the atcp of: 
storing die luscr selected attribntcB inmemoiy. 



13. Ameiliod iaocecudaiice wicbone of daims 1 to I3« fUitlKT comprising 0x9 siqis oft 

dynamicolly dctcnniolag the lopatioo of oo or more 
dispUiyed lolevisbm eoea^ and 

atttonratically aiyufitiiig at i«8« one of tt» use^ 
piosenoft of the diq^layid closed capdw infibtiiitaiiOD teM daiiactiae baaed on ttie 
locadoo of «he om or inoro olyects of tniemt» 

14. A method in accoxdaDoe wids one of gIsubb 1 to I3» oomprMng the iiictfier step ofi 

aioring the eloBcd oaptioo infiomation hi mecnocy; 

15. A inediod ID accoidflnce witb dahn 14, whemn 

atoml on one of apermol vereatilerecocder, a digiiBl television* a difiilal video 
leeoMei^ a digilal video diak player* a 8et-tq|> fiena^^ 

16* A xnediod in acGOidsnce widi etaim i4 or IS, wherein tbe aelscted attribufea 
tDctude tbe option of avIonuHcalty ^eocsering a transcript of fiie teteviuoa 
prognunming fioin Ibe stored 6 Uvsed oaptie^ 

17, A tnedObod in aceoidanoe ^tb daia 16, coR^inslagdie Airtber step of printifig die 
ttaoacsipt. 

18. AmethodiftaocoQtbnoewidioneofciaimB 14 to IT^oomprising die further step o£ 

providing user cootio)led replay of die stored cloeed caption io&miAttoo. 

J9. Afnetbod io aocoEdaicioewjtbom of claims l4(o 16.0QocRp«i«hi(gd:te totih^ 

pflfovtding oa^^scretn review of dosed caption tet firom dio stored closed caption 
inSbfxtiaidona 

20. Amedtodinaoooidaficowidioo6ofdaim$ 14iol9,contpn«ingthc<Qftfaierftcpof: 
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tetening imo ite stomi etesad ck^m iaflMmfltkn iit teost me of page numben, 
time find date of stoRDg, and lei«vinon progicam tiQaL 

2L.Aoieilu)diiiaocoidmeewtthoneftfola{m 14lD?0^ co w y i MD gfl»ftiitiier6tepof 
oansfeiriiv closed CBS/Ootk lexi from the stared dond capiiQA infonnaii on to writefible 
modUL 

22. A methjod is Booordance vfttb one of clfiisiA 14 to 21, oonprisins (be fwtim etep of. 

traD&<bniiigda6od«aiM0B<«xt1to^ to 
QQOOfapriiiMr,of»fMiialv«n8tik recorder (FVR>,o digital televiaioiw « 
rseoirdar, a digital vicfeo disk idayor^ a set top tonninalb or a peysooa) conipBtcr. 

23* AtncOiodinacogirdaDccitfithoneofGlaims 14lo22,oooiprtsinglhs£»itlttrsiq» 
pnivjcKog file maratgenMsok fimctioAS fiur mult^le stored doeed c^idoo fil^ 
wtamn each ssorodi^oeed caption fOe cosrwpoads toa ateglctOevialoii ptogimi. 

24. A mattol in acoMfaDce witholabn 23, wturan said life maDBgenicnl fiuKtiona aio 
ppcmded byomotf^ porBooal venatilo iocorte» a digiial (akrviaioc^ a digbaJ video 
xacQidEr, a digital video 4IA pieyer^ a aet^top tanninal» oc apemma) oompatar. 

25. A xnetboi in aooordasoc with one of claim 14 to 24> coiaiMriaing dsc ftirtbcf aieps of: 

providaig ftrtbc insertion of booloaaito info eloaad capcton toxtof the sioiied 
cktsed captioci idffeinatiofk; and 

provtdiqg for Ae locadon of die bookzoarka uiaertBd into tba closed caption tsct. 

IS, A mediod in acoordaaoe wicbone of cUnma 1 to 25, oompriaiog the fui4wr slop oft 

removing displayed cloaod o^on inionnadflDader apgredetcvmioed timo period 
in wbiob no closed caption infbvinaiioD is leceived 



27. A noetiiod in acoordance with one of olabna 1 to 26. oomprtatng the fluiher step o£ 



as) 
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ptoviding iyrmw adjustmeot of closed oaption text color wtoi a uafispareni 
closed CAptitti hBckground is selected 

28* A method in accordasoe ^'UL oee of cMms 1 to 27» coin|>risi^B the fiirtber step of. 

miliriiig Unioode cbaiecter teetsiolog^ for imcmaiiopuHyfrtifln of dosed ca|rtioR 
tefonnstfofit. 

29. A method ID scootdBAce with one of cteims I to 28, cosipmuig the Auilier 8tq> of: 

receivuvg an Emcrgeney Aim Siipial; and 

avUmatieeliy oveiridifig Ae mer selected attributes in oovkr to avoid wvi^p of 
die dis|dB>Red dosed cepCson infbmiatioD with a dbpley of die finergeDcy ASevt SifpiBL 

30. A iMStoi in socofdaDce wUh ooe of olaims 1 06 29* wkeran the user sdecfed 
attributes cao be disabted on at least ooe of 8 per fragra^ 

31. Appamos fx provision of tifier selected advaziced dosed captions, compristD^: 

aptooeseorftR 

exMctteg dosed etiptlon iaCbnnadon ftoma 
tdevssioo sigmsi haini^ cmespondag tdevision fw^mvodngi 
dctemrisnngvdielliKQneoriDOfvuMsde 
a dosed cqytion Mver ftar applying ^ Itm one user sdected attribute to at least 
a poFCioB of the dosed eetnloii Intomatioo; 
a display driver; and 

a gn^bios piocessar fiMrdbi^laytng Ae dosed eapden infi>rmatioa recdved ftom 
the display driver on a display deviee tn aeoordswe witb the user sdected attributes via 
a grspbteal omlay oo top of die tdevisioB pioyrsiiUDm^ 

32. >^4iparatae in aocoidanoe with daim 31 » totber conqmsine: 

a receiver for reedving tbe tdevisioo sigiaal; 
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a demodalstor far dmodulating theielevislim si^ml; end 
« d68Cisndilvfor<i6Bcreinbli^ Ihe television n^ial* 

33. ApparnitsiDaeoordamewiftdaimdJ €t^ 

closed cepttan amibutAs are flppHed to dosod caption infbnmtton received via ooe of a 
deUveiy network, a per50italvemtiIeceooni6r(PV^ adigilal 
mievisioD^ a persona] €ofi^)vt6r« a video CAsteite 
digital video disk pla>cr. 

34* Apparatwinaooonhooewidicmofdaimft 31 to3S»wlwitiiidieappBratin 
con^rises one of a personal ^matfle tecon^ 

reoQsder* a distal video AakplayoTi aaettopieniniial^orapecsonfllooRipiiter. 
31 Apparatus m aoooniaiioe widi one of ctein» 31 to 

attribolcs ooniproe at teaust oosof IbclC sizei fimt type, font ooloTt caption window 
positioQ, dftwt window aize^ phnt direction, ftcco)l direction, scrol) ratc^ text opacity, 
baekgnHiDd opari^* text juftttficatioxt loft, tat juaiirioaiicm rig)it» 1^ jastification 
ceotcr, and background color. 

3& Appafatus in accordaace widi one of elam» 31 to 35, wbeiaiR: 

the closed caption ^aSomaOm is diftpl^red one or eu»e doeed captioo boKca. 

37. Apparatus in aoooffdonce with claim 36, wtieran muhq^le cloaed captioo bcoLes aic 
diaplajml aimtthaoeoinly. 

38. Apparatus ioaooofdancawMi one of claims 31 io37,wl»ram: 

the closed caption tntbiiiunioD is tagged wbh an ideniifior that distf&gnidits It 
jftoDi televisioo pfograniming data; and 

flic closed caption infocmatioA ia eiancled baaed on the IdenlrQec 
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i9. A^mcoB tik ocoocdaxm widiooe of claims 31 ca 36, whcran: 
the televuiOD sisaal oompnses on MPEO-2 trampoit stRan; 
ttie closed caption ifl&ciniMlon u earned iD a 

of <be MFEG-2 CraaBport sCTBara; antf 

the cloeed c^pdon iiiibRnotian b exir^^ 

40. AjpparfttoshtfMcoidaiioeTntboatoofd^ €039, wbeKbi^oxdi closed caption 
mfimnation cocnpriaos one of dosed caption snfoimalioD ov BIA-70S closed 
caption tofcttitttiofl, 

41 . Appaiatw in occoidanGe liHCb on of dau^ 

anribotes aie entered via at least ooe of a pop-up menm a diaiogue booc, and a poH^wn 
windowmcnn* 

42. Appanm» in acctsdoisoe with ooeof daima 31 tt> 4l« ftmbcar cosnprising: 

a momory device for storing the tisear setected attnbatea in mmiofy* 

43. Apparataa fai aoeofdance wito data 3I» wtieieio: 

ihe location ofone or more objects of teemi i^ eoeneeio 
dynainioany detttnunad; and 

at least oaa of dtt uatr sdocted acoibutes is aurnnaticaQy adjusted to make Ae 
presence of tltc displayed do$ed caption infoonaticn less diatraotiog baaed on (be 
location of die one or move ob|ecl8 of interett. 

44p A mcAiod in accordaim witb one of dabm 3 1 to 43, ft^^ 
xnemoiy finr stoiinf the dosed caption hiftyrmalkak 

45. Apparatus In aocoidaoco with claim 44^ wheireio the apparatus conipnses one of a 
personal venadle recorder (PVR), a digital television^ & digital video leooid&r, a digital 
video disk player^ a set top tennfna)^ or a personal conipoter* 
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46. A|ipmiu$ in MMid&iM^ 

include the cpttei of oncoittatieaily genmtiiig a mnscripi of 4m television 
ptogiBRuniiii^ £(Otn (he ftlOfod ^osed capdcpn uifimiiftlioiL 

47. Ai^atttdittMocmlftitt6wkhdaha46^wbematiietm 

48. Apparaiu$ to dCOOidAOoo widione of cldtns 44 to 47* wlieimusec cotitrolied replay 
of the stored closed eapAm infonnetioDlBpnyvided. 

49. Appontus in oooofdaBooiyidi onecf efedins 44 lo 48, v^tereln on-BOfeea ttvtew of 
dofied caption text ftom die stared closed captkmiofb^ 

50. Apparatus ioacooitbintge wifbonc of clai2m44 to494 whrnin at least one of fxiee 
immbere, time and data of storing^ and talevfsioniiio^fam litlo is inserted into tbe stored 
closed eaptiott io&nnatioo. 

$L A fneSx)d ID aoGoxdsnoe witfa one of clsintt 44 to SO, wberot^ 

ftoo) die stored dosed csptioa fofcimatioii Is trsnsfmod lo writeable xnodia. 

52. Apparamg insocoidaoce whb<mtof cielnis44 to $1, wherein dosed ception text 
from Ihe stos«d closed captioaloS^atiooistraAslwedtociieof epn^ 
versatile reooxder O^VR)^ a digital ttlevisiott, a digital video reco8rder» a digital video 
disk player» a set top tenninal, or a personal oonqnita'. 

93< Apparatus ill aocordbooe wiO^ one ^olwns 44 10 52^ 

pfo^\ides file managemcsd fimdioans tot mohiple stored closed captioD fiilefi» vHbiexein 
eaell steited closed c^dooi file coitesponds 10 e allele lelmsiTO 
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$4, Apparatus in acooi4aQC9 wiih ctoiin 53, iMierti& wid BppmtboB comprises one of a 
penonal vatsatile i«OGxdcr» 8 digbal tdevisioa^ a digHel video recocdet* a di^tnl video 
disk player, a <et*iQp tenniiial, or a paisonal 

3S. Appaf&iOB in aocanianoe witib ooe olclaiins 44 to S4« ^emn: 

iceeiting of bookzosilos into clooedCQption toKt of thv sumd phased captiofl 

ittfaniMton is ^Vided and 

locadng of the bookmarks insened into closed caption text of tfae closed ceptioo 

inRuniatioo la piovsided ftr 

$6. Appaiani^ in aocnrdanoe wiih one of ^aima 3 1 to 5S, wteretn the dlq>)ayed ^toaed 
caption infonnation ia removed after a pEOdetetniinedtiiQfr period^ 
caption information is Deoeivedi 

57* Appmtua in acccidance with one of daima 3 1 Id $6» whectin c1o$ed caption text 
color IS dynamically acyuaied whan a tianqpareot closed caption baekgrocnd i» aelecM. 

58* ^f^afacna In aecoidaoca with oncof daima H 57, wliereinUotcoda cbaiacifir 
technology is utiibsed ftr InteniBttoiuiliZHtkiQ of oloaed o^on infiKmation. 

59. AppaiBtus in accardaooe with onoof claims 31 to 98, wlmln: 

in Oie event an Bmes:gency Alert Sigoal i» received, Ihe nseo: edectod attribotes 
are automatiually ovenidden in coder to avof d oveiktp of die displayed closed caption 
infom u rtk an with a display of die Emeigency Aleit S(gnd. 

60. Apparatus in occoidaiice widi one of ^ainia 31 to 59, wborain ths mtr seiacfed 
atnibutes can be diBd>led on at least one <^a per piogmm baris or a per dh^^ 

61. A maikod tar the pmvisinn of itser selected advanced closed captions, compilsing 
CbeatepBofi 



extsttciiiK tte closed oapiiim inl^^ 

detensdzdng whofter one or more user sdeciod ettribanB have been set; 

applying at least one uaer selected alMbute to at leeslaponton of tte closed 
caption infonnalioo; 

displ^ing die ciosod captian infonnati<m oo a display device in aocoidonce widi 
Ibc user selected attributes via a grqiducal overlay on top of the television progiraizuniiis; 

dynamically detarminittg fhe location of coe or more obpeoa of interest In a 
diapln^d tdeviston soene; and 

AutoonticsJly a^uatios el leset one of the user sdecied aftUbufes to make Ibe 
preseace of die dssplayed closed capciofi infimiatiosi less distntctteg based oq d»s 
loetitioa of Iho oiusor TDore objfisett of tf^BiBst 

62. AppsratuB fjor tbe pioviston of iiaer selected advsooed doaed oapliaos, oofmprismg: 
a processor ibn 

e^metiss die dosed cdpdoa inftafoiatlQa fim 
televisioD signal beviflf associated television prosgrammins 

deteminifl^ mdiether one or more user selected atrtbnte s have been set; 
B dosed caption drivw far applying at least ons user selected attribnte m at least 
apoEtion of tbe closed «9tion infennatioa; and 
a display diiven 

a graphics pcooessor for diq^layiog tbe closed captiee infbnnation XM^eived tarn 
die display driver una displny device in accordaoce with the user aaleeted attribncea via 
a grapblcal overlay on top of die tdevisioB progitamming; 
v^hexni: 

die locatioa of one or more ebjeets of interest in a dispilay^ 
tfrlevlaian scene aie dynamtcally detemiined; and 

at least ooe of the user selected attributes is automatically 
adjusted to make the presence of the displd)^ c(o$ed caption infonnacico lass 
distracth^ based on die location of tbe one cr more objects of insexcst. 



Tbe pmeDt tnvention relates generaBy to tiw pcovistos of dofed ^twring for 

5 tcl^isioii and other eudtovidiwl programmiDg, In partkwlw* the preseat fawmioft provides 
advanced dosrd camloa ftamres usinf caiisting closed (apdon mlbmiadnc camod in tbe 
tolevislon signal. 7^ invention allows A t2ser to oveirufe the etoed oipiioti presentatioD 
fttout as sekcted by tte arigiaaior (e*. pi^Bsanmcr ox bToadcastw)* in oc^r to eclcci 
aliwoRtc presatuadoo attribntea baaed on the uaei^s jaefaence. User ctiatoimzid>Ie advenoed 

> ctoacd caption fcature» are ptovUed, audi as Tom siaa, bm type, fim eolor^ caption ivindow 
poifitioiw capthM ^dow size, print dlreetioiK, serolt diMctloa. sooll rate, taxi opsdQ^. 
hockground opacity, text Jusnfica^ left, text JixsiUkaiion right, text jusit6cimoD center^ 
hackgrouAd coior^ and the like. 

Qoised captiOAA a^e captions thai ase hiddeix In tfte video aignaU Recoveiy of closed 

i eaptSons for dismay alomg Ufith the tdevblon piogimmiidag requires a doeed captioa deecder 
to b« osod w comectlon with the televsaloa lecetvet 

Bediming axound 7980, cJosed aqpttoning of video progims bx (bo United Slates 
utilized Una 21 of the V^icai BlBRkmg fotemi (VBI) of a Natio!^ Teievidon Standaids 
Commiixee (KTSC) television signal to ceny ciottd eapUwi data, hi 1990» Cojjgrcss passed 

• the TV Decoder Ciiciuiiy Aci» wUoh lequlied closed captioa decoders m mou trlrvialon 
receivera. 'Ine TV Decoder Cncuiny Act requited Che Federal Ceaxnvnicatiofis Coaunissioa 
(FCC) fo ptodoce standards for closed capdon decodcis. The FCC»i»iihBSsl8taii£e froisj the 
ileetronic Industries Assoctaiion OBI A) TeJevinos Data Systems Std^coarnihter* has 
developed certain standwds lor the d^vezy of dosed e^oos; indoding the EIA«ti08 sod the 
EIA*708 standaids. One tecfantque {br comnswiLcatiag VBI data» stscb as cio^ captions, in 
dig^ Celevision deia streams ia dbdnsed in commoaly assigned VS. patent no. 5A44filS^ 
aniidedCotmnuaicotiOAdf VBlDfttaia D^talTelemlofiDaiaStraanis, Incoipoiiated hcxcm 
byreftieifeoe. 
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The EIA«6W standai^ developed m 1991, isbued on tbe Line 21 system Bod utilizes 
die DVS-157 mndmd fixr eaiA^ Ibmat of ifie EU-M8 capttom in distal cable system. 
DVS-iS? b a amodaitl tbai baa teeo establuhed for On cable Indostiy by Ae Digtnl Video 
Subcommittee (DVS) of die Society of Cable Teleeomnxumcatioiie Cngineen rSCTE^. Il» 
EIA-608 closed £B|ytioR9 m provided h a ringlc, unalterable conQgumioit 

The£lA«?OS standard i9 a new stajidard which was devek>^ id 
v^idi utiBzee die oaniage fcimat specified m dK Advanced TelavisimSysteRi Commitiee's 
(ATSQ A/53 standard for di^ video. Hie E1A<?08 atandbtrd is loeant to provSde 
*'advfliiGcd'* dosed coptiw taxom ha digimt idcvteoo sigivda « Ibe Closed C^ptioitinf 
origination device. The E1A<708 ^'advaaocd'^ ftaunes iscbde, bat aie not limited lo, the 
ability to change certain closed caprion fcaiutcs^ such as die locatiDn of the dosed ceptioQ 
display* end the «ize and color of the doeed caption text 

The A/53 fomwt used by tbe ETA-TOS stsndaid Is not backww) coonpeiibie Mth 
exiidng digitftf cable systems. MUlsoes of esOMng set*lop temkinals cumody io 8se hy 
eotuumeis sqppoit tbe EIA-S08 standard cenied iSfiial^ iaDVS-1 S7. These set-tap 
temiissaJs are Ines^ble of being ttpgraded to acconmodafe die A/53 foimai titiliaed b. the 
EIA-708 standanL Replacing the exisdi^ set-top tesmioids whh ELA-708 compedbie eystetos 
would be cosily to consumers end operatovfi alike. 
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SUMMARY Qf THT> INVf rNTim 

The pre^em invention rtiatm feimaOy (o tha provision of closed eopiiouii^ fbr 
tekvinoii and other aodlo»vuudl pfogxatmnicg. In pQft(cu]&r» she prttcoi im-eoiimpmidcs 
user customizaUe advanced closed caption Cemm using «xbtm$ dosed caption iofonnation 
coirled in tiw lefeviaion ^tgnai The user cxtttomizable advanced closed caption j&atutes 
include ftetuies 9adk as font steOp fbnt cype» jfoot oolor» coition window posztton, caption 
Mfljidow si2e» print dmcdoi^ a^oH diiecden* sccofl xbib^ ten qsadQr* background opacity, 
loct Jnstificatica kfl, laxt jimificatton right text jastiikati«k ceitter, baek$ioi»d colciv and 
tbc tOpe. Closed caption toibimadon is extracted (e.6.« by a ctosed caption proocsBa*) from a 
televislw* Signal, vftdch lelevision aigi»l also oontains conespoitding ie)evi$inn progmnaxnlng. 
The prooesaor dc^ennines whetiier one or more user selected attribiKca have been set. At Icost 
one user selected attribute b applied lo ai least a po!tioo cf d)e dosed caption information 
(e^g., via a closed captioo driver)* The dosed caption mfonasdon ts displayed (e^!^.^ via a 
display driver and gmpiacs proceasor) on a display device (e.g^ a televisioo acreeid in 
accordance Mlttx the user selected attnbutcQ via a graphical overlay on lop of Ihe television 
progiaxnuimg. }n nadumsr, user selected advanced closed amnion ^uiures cm be pcovided 
9ei the display device t)$ingexinlnEelo^ caption bSx^ eontauied witfasnthe 
fdevidonasgnal. 
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DRTAyr.FT> DESCMroON OF THE l^VECTffl^ 

The 6fisuizi8 detailed descTEpti m iirovidea pEtftned esdsodSmento qOy^ mi 

h not intaAded to limit iHe scope, appItcahniQ^, or e<m6guration of tbe inventkm* Ratlsr, Ihe 
eASUiog detatlsd dfiscrii>tJoii of the ffeftvred exempJaiy embaAncals |»0vide ttiose 
ddlled ia the an wifli an ezi^liag desu iptlon fbr impkmemus^^ a pzvfenvd embodimeitf of <he 
i nveaioiL U shoold be uDdentood Ibtt vv^^ 
mngemeni of dtoieDift mduiut depait^ 
ftrtfi in tbc as^peiKfed clsiias. 

Tbe inveixticn b deactibed lo connection with dosed caption infijcnunion, which 
ctiottid be imderstocd to inctude not only closed caption vsx% but aiao my other infornian'oo 
necesaaty for the dlapiay of ctoscd C9pQoo$, iiDcludiag hiawi limited to coniaxtiia] aodi 
graphical irxibnnaaoiu Hcnvever 
invention b not Imiied iQ GuMinizi^ 

invendon can also be impk&iimied to allow fbi cusmrizaUon of aagr type cf lextaa] 
m&nniuioa contained withlti oi aasodaicd with a video lAgmsA, such aa sabdtlcs, etock tickers* 
adverdsit^ bannets^ eoMr jency akn algnals, oztd die IQw. 

Fieura 1 is a block dlagrarti of bo exsmplaiy cmbodbocni of the pinasenl inveatioa, A 
adavislcn signal 10 ocfnalaiag cloeed caption lofotmatioix and assodaiiad lelevimii 
pregreauDlag Is peovided lo a pcoeassor 20. UsereelecsedcloMdcapdoft aitdbiitcv 12 are idso 
provided to lhcproGes$or 20. Tbe procesm 20 extract tbe closed cvdo&iitfimttdc^ Tb^ 
umsdectei attributes 12 aieappHed to at least a poniooofthe extracted closed capdoa 
iofonaadon by ectosedcapitiQadiiver^O. Adispl&ydiiverM 

tnfonaatioa with user elected attributes to a xr^iks processor 4$. Tbe ffaghlGi processor 
45 provMes tte closed captitm in&nnatioa wtdi the ostt 

atfspl^ydevlceSO* ThectoaedcspdavdriverSOaDdthediapJaydchwMmBOrba 
Implaipenied, e.g., as software or finnwaiB cm or asaodsfied with tbe processor 20. The 
graphics processor 45 is iropleiaedted in hafdware and finsi«raie. 
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As shown in ngm 2, tbe nkvlaioii signal lOngy be icccmd ala tuner l» anH 
dmoduIatedetdeinpdiikaDrTOprtoftD&eGdn^^ Bl 
ite pQce9Sor. In addUon, if scxamUel ito f^wteion sigiid 10 wiB be danataidblnl Bt 
d^scrambkr 80 pricr to tbe extiQctlrv of ihe closed caj^rion infosDalioiL b should be 
appredaM thim skilkd in the lut .proossscv 
will also b9 necessary Ibr psQce^sins Agitsl dsta streams. TUis MFEO pfocessor c» be 
to^Icfiiented as pan of prqceseor 20 cr as a sepATBte pim 

dolled in the an will appreciate thai the d^xsi television signal la fecweided fiom tbe videp 
piocessiv (VDP) on the bus to a gniptto pioeessor, Nba cbe sig^ 

ibsX coQSrols bna and bmst nx>de distal vide9 traosfcn^ then ibe signal is iVxrwardcd to whtae 
VB! ineenion is penGonned (fiom the mfbcmation fbrwaided to it) and finally <ligli:d/<aseIog 
(NTSC) coovers'ioa is per&nned* 

In a preiened eosbo^ment of ibe inveniion as aliown in FigoTc 3» user selected 
advanced closed eaptioos are provided* Qossd caption ii^^ is«xincsod(e.g.,bya 
closed caption processor 20) from a television signal I0» wi&h idevisioA signal aisQ oosialns 
cosnespondiaa television pragiammtng. The proeeaaor 20 deienniikcs tn^eibaf 
user selected attnbim 12 ha%ie been set At teas; one user selected anribate 12 is applied lo 
at Ir^st a poctioaoftiie closed caption iQ&raiBdon (e.g., via a dosed capdon driver ?0)» The 
dosed capdcm izi&nnation is displayed (e,g., viae d^^ dttver 40 and gsai^cs pzoeessor 
45) on ndiq[»lay device 50(e.g.,atBkvi8liMi sereen)inaomdanceMMidiei]8ersdected 
attributes 12 via 8 grapliicBi overlay on top of the tdevirioapcogrmaiiqg. In (Us nuanBr. 
VAfff selected advanced closed caption features can be provided nsosg eacisting dosed eaption 
iDfonBaatioo contained within the television sigosl. 

He invention niaiy be in^deroeaic d as pan of a set-top terminal, a di|^ tal television, a 
pessoad eoniputer, a digital vidto reeordlet, a digital video disk player, or other suitable 
devioe. Ahernaiively, tbe lovenllonAay be iniplfiCMnted in a standalone 
shown in Figiue 9 whkb receives a television or other i^deo^^ lOandsscoivledtDa 
^spliKy device 50. The user selected attribotes may be appUed to closed caption i 
which is received (along with canefiponding tcievlsioQ p rogi aa uning) via a parsooal vofsatiie 
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twof4er (PVR), a aewop temisml, a digital tdeiisiim, a peRoaal oompmstp a video caMttte 
eeooidertadigitdvid8onco9der,adigitalvkb&di^ la^ 
aHeiiiativ«,aetelevisioA3igsBl lOcomahdqgihectoeedcapcktt taifimnatEonasdassodtfttl 
television prosrammtag may be received via a deUveiy tyetmak, sadb as a cable or aatslfite 
television network, « tcrtesoiei uetworfc ih» I»ieniet» or otncr Bohable communScatioD 
mwcak. Thoat $}uSM in the ac4 will appreaate tbac fte televiston fllgoak discussed hetcin 
incliide aot oi^ txaditioiMd types of tdevidoa signals* but also my mm-tiaditioQal telas'^ion 
8l«iial8 0«imiBin8 closed caption or other lexattl^^ Porexai&|da,tl»teirids!onsiSQat 10 
may oompHse an analog signal^ a bfoadcaai or oi^demaad dlgtfal ai^oaj, singleeast or 
multicast 5treBinlitg madia, asd the tike. 

The tuer selected attributea 12 fiuiy usclude S^t 
window position, c^itioD window ^ize, pito dircctioa, scrpll dhecdoc, scroU taiej loci 
opedty, backfircund opacUy. taxt>aAi&adaQ text JustifiCatioa right, text jtiatlflcatlcn 
eeQMr» background color, and tha ilka. 

TIm dosed cayptioninJbcaMaion marbadiq^layedinoaaor awfeeloaedeqHton 
bmoa. Multiple dosrd c^rtion bosiee may be displayed ^inniiiaoeoudy (e.g»» for isc wUi 
pictuie^lot'picturc features or to provide vie^nng of ttse dosed cap&at ten Jbr nwre than one 
chanael wtdia vievjiug a single tdevi^on prO£^). 

Tte closed caption infonnation may be tagged with an idastifiar that distingu siias if 
tinim the lalevMion imigrammlcig data Tlia elosM C8^ 

from the television signal based on the identificT. Tlic taievlsion signal may eotnpcisa an 
MP£0»3 tranapoct stream. Tbe dosed eapdoa iafegnarion may ha caofied in atsei data field 
of video data syntax of the MP£CKJ tianapoit stream. In sudi aa ea^dioent, extractbg tbe 
dosed caption inftcmai&)n n»y be pcridrmed based on ibt user data fidd* This applies wbeo 
working with. Cor exaniple, EIA^^ standard doaad te^^ tnfbtn»tion» Pursaant to the 
BlA«60g standaid, doaed c4>tion bytaa In DVS*I57 ate delivasd in the uaerjdala syntax of 
the vklao ^ntag of DVS-018» sMA Is coiapatibie with the vldao syntax of A/S3, an ATSC 
Oigital Tdevtslon 9tandan!r Hie eoeode^ (at dte oti^tson Iccation) incorporates the caption 
bytea^ as £9j>varded via one of Its intsilaaes* SaUowbi^ the syntax in itaerjdata of the video 
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syiaxax ct a digital stRSRL The decoder (e.g^ sei^cp tesnifauU), wben decodtos a digii&l stteam 
reoeivefi these bytes i& the afbiicnifiBdoii6dfemet,e)ctii^ them as eo 

EI/V<^8 VBI ^iffiBl gci (be fiftalog dgasBL This analog signal is a ruuitt of the decoder 
decoding the digitel <MPEG*2> stream and cosventog it to ao aoaiog NTSC sigtaJ* 

The elm«d captfoo infikm^atloii mty compdsc one of EIA-d08 cloeed capdoA 
hifoittatioa or £IA«?OS closed csapSoo infoizniUiGiL 

The user eeleeiied aitrlbuits can he emeitd via a pop-vp monu, a dialogue box, a 
down Myiadow mcnuL or other guilahle mechaiigm or cnmhtmriAn «f niwlii^^fnf. For 
example Figure 4 a raeAu3<X)ofumaeleciab!e closed cap^ Figimi 
ihowa cKosed capd^ box aoritates 305 es box poaitiQv box width 312« hoK beig hi 
320, border 32S» apathy 33D, boot color 535, priority 340, Atw capcwn box 345, lock low 
growdi 350 and lock cohuQQ growth 335« Closed caption toctattributca3dO are also sbowc, 
indudfc^ joBtifipition 365, font dze 370^ opeol^ 375, fiut lype 330, fbsa color 38S» and 
aii(4iarpm]l390. Figuio58how9aiiia»i4GOcfidosedcaplmcoofi8urs^^ 
those provided pursuAm to the Ef A»708 standard, '^^ddx indiom die tfpe gf text coioteiit being 
displayed. The tags 4 10 iaclude indicators cf soch as dialog (rsOQiua woids spoken by 
characters in the pro£ramnii&£)» aourci or speaker idendiication {name of ihe speaker or 
eourcc of eound)^ elecoronicsay reproduced voke (spokeo audio Groa a phone, radio, PA 
eysiem, aod the UkeX dialog in leakage other than prima^ piogmns 1aogoage» volceover 
(cianatiQn or other diaenthodicd voice not heard t^y die pcogtom'a duractereX au^le 
traoBlmson (voice of diaethbodied tcaatlator not beard by the program's charactezsX aubthle 
lraa$laitoa ((em abowiitg a tramtsUon into the pnroary language of the programX voice 
<}uality description (deseripdon of a voice qinliiy). aong lyrics (worde beix^ aung), &ound 
cffeoc descdptioQ <a descripttoo of a ooitvestal sound or louelc beSag heard by the progmm'e 
charecteis), musical aeore deeei^loa (a deae^iptkn of hackgrouad mode not heard !>y the 
chajcacecr*s hi the program), expletive (en uiwj c v t wy woid or exprassioc; possfbly profhse or 
hanh). 
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As dio^ m Pigtti« 3^ae i»er Bclected annbm 
Multiple aiiributa $enivg8 mqr fcevUed mh dat <lifi0«iitum c«a stoft their tespccdve 
jmivxreil eaHbutes for fiihue oBe. 

In « fft&fted eiabodisnem of fbe invontloii. ihe pioceffior 20 ma^ dynaoilcaliy 
d^tcnniae tite location of one or more objects of ifUmst in a (UspU^^ trlevisbn eceoe. Once 
an objed of Lnterest U identified^ at least one of tbe user wlected aftributes 12 can be a^gusted 
to make the presence of flie (Bspiayed ctosed c^tfam infonnatioo less ^gstrectlofi based on ihe 
location of the one ormoie ol^Bcts of inteiot 

Hieelosed captfon inforniationnay be ssorai in mesKMry 90. The dosed cap^ 
infommion may be sawd on one of a personal vmatUe lecoidcr, a digital tdcvisicnt a digital 
video recorder, a digital video disk player, a $tMop tennii»l» a permial computer, or other . 
auitebie device. The user selected attributes \1 may incluck the opdon of aufocdsiicaily 
gcneracmg a transci^ of die televuioQ progcanunbg fioin the stored closed e^ion 
ittlbmiadon« Tbe transcript may then faejHioiBdfiQm an aasodased printer 

Uacr controlled replay of the stored dbaed capdop hifornuidon n»ay be {maided. On- 
screen re\'iew of closed caption text from die Kcied dosed d^tion inftnoation may also be 
provided, which niay be a fyiscceendispiay or a psrtidicre FagennntberSi 
time wid date, and program dtle tnsy be iosencd into d» stored dored captkn bfbmiaiioa 

Ctoeed captioa text ftoni tbe stofed dosed eaiptioii 
wifteabia media. Tbe wrlteabte madia nofyoomprlae memory 90 eontaosd ^;iidm 
deilce whkh provides the advanced dosed capdon featutesr Ib die alternative* tbe wiiteaUa 
media jogy be located in a device sepaiatc ihsn that which pnmdes ihe advanced dosed 
caption fitatuics. For example, the closed caption teict ihmi the stored dosed caption 
information may be nansfbred (c*g.« in Rkb Text F^nmu ^1^) to a pecaoaal compuier 1 10 
for sionigeona hard drive, CD ROM^ dlsiaiie,orany otber eiiEifllsle arorage devlea. 
Stmllart}', tbe closed caption tasti m^y a!so be tranateel to a prtoter 100^ a persoad veTsadte 
recorder (p VR) 1 20, a digltd tdevifdoo, a digitd video meoidar, a d(gUal video disk player^ a 
set top tecromdi or odwr suttAk device for fioiher persoi^ 
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Fife iBfliuigcsneiic fiincttw^ xsay be prpvidotl foa nviUfic stored closed cdpdon fUc^ 
whemn each scoml cloved cRptUm fito comsponds to a flfa^Ie ukii^iMi mvgreni. Tie iSe 
oamBmeot funcitou may be luovided by q psnood vmatite focorder 120, a vMeo 
Mcofte p a dighal latovisioo, a digitid video disic player, a secHop tenniaal, a pecMoal 
ccHoputfiT 110, or oiher 5Ui^hIc de\rice. 

BoQkinflrk& tnay be r&seited and nibseqaeatly bcated in Uie closed caption text of the 
stored closed caption {jsfbnnation by a user \^ e.g., teoiote contioL 

In an altemm embofimese. cmtently displayed doied oqukm infonnation way be 
removed after a predeiemdBed tlmie pcjfod is wlucb oo elosed eaptkm infoozimioa b 
reosived. 

lo a &rthtr embodimfint of the invemioii^ dyoamic a4)^!'^^'<')fCni ^closed caption test 
color is provided wbea a traasparciii closed capdon background is aeteeted. Whea a 
transparem baefc^rouod is selected, the closed o^iioD text is pceaeotcd ditcetly over tbe 
lelevlslon programmiiig. As die color of itie displsyed taleiMoo pfoaranuDlog icay chanee 
periodically, dwre exisra thopott&bljr of conflict widi the ohoaan ooloar of the closed caption 
texL By dynamfeaUyadjustbg text ook>r,dis dosed caption lexfvvffl 
die a»l«vksion pf ogramndngr Those skilled in the art will sj^jwcciate Ibat such dynamic 
adjostmeot ts moxe appzopriately provided at ihe origiodlion ait9 mdw than at a destination 
Jocachm due ip the diffScoUty in the ptDCessioy (real-thiKe) whkh would bs requirsd at tbo 
dewtnarioii or v»wing loeaiioii. 

Unicoile chamcier teebnnlogy may be inBized in order U> provide iotematlcni^saiion 
of iha dosed eaptlon infbrmaiion. Unicode is an imematlonal standard for repraacnting aifinss 
(concatenated ctoacters) using l6-bU cbaracteis (65^36 poasihle charactexs). The Unicode 
ataodard allows for non-English alphabet characteta and graphical symbols. 

In an alternate crabodfaiMsttoflheinveniiQ&»tbe user selected anributes 12sn&ybe 
aiiioinaticalWovcniddeAM^hanaoEBiargeDeyAlen eeceiveduieidettoafVoM 
overlap of the displayed closed cation InJbmnsion uflth a display of die Etnergency Alert 
Signal. 
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nietaer elected' aaribu&cs may be dte&bl^ channel 

bads. 

It6boitIdoawQeeppKdmedtb«tib9iffv^^ sod 
^paiaius which aib w laer 9elco(flbIe sdvanced c2o9«d <»pHoct ftanim to be ganeiatod using 
existing doeed caption in&roialion. Hirther, ihe ftfcficnc ioveotloii apconunodates both tte 
Bf A*606 Ataodard and dte EIA»7)[M ^Bnd&rd dMetfc^ptioaB. 

Alib<mgb the inveittk»Ju« been dadcif bed kieoiaaeedon vrith various illiismied 
emiboGimeiit8» nuxncrou$ modificfetODS aod adaptations may be made dneto wUinia 
depeictog ftncB dk spirit and scope of die 

A Briti iDescfi^UQR of Drisiim 
BRIEF PgSCMimON OF THE DRAWINGS 

The pissent inveolicn will feercvnafier be deacribed b ooiQuscdon with the appended 
drewins ^uvea;, wbcfcbi like iwmefals danoce 

Fifidrc 1 8bcm£ Uock&siaro of ancxensplaiy ei^ of due invsntioa; 

Figttte 2 shows a block diagxam of a toth» exemplary embodeneot of dm invention; 

Rgere 3 shows a block (BaeTam of a pceftned embodiment of tbe invenlbn; 

pigvie 4 show£ ao example of a menu box (breoseriag die nsar selected advanoed 
closed capdon attributes; end 

Figure 5 sbow« a fiifdier example of a nsenu hm for entering addltioRal user selected 
. advmeed dosed capdon attributes. 
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UsercuBlociiisAle adVB!weddo«odCB|Rkmcii^^ aic provided issiii$cto8etf 
c^iion infbnnation, such qs Oxer d«9crSbed in the Electronic EnhBtdes Assoeiatioa ^IA> 
Tettvbion Oma Systems Sabcanuniitce 9land«rds, or EIA«?0S. The mvcntion 

aUows the user to oivtrride che dosed ^ptiofi p re w i toii cm fgnosi w selected by ^ origmator 
(e.g.» pio^nmer or broadcsster), in aider to eelect aUesmte itraeoistlgo fttuilmtcs ba^cd qiv 
d» ttsfti^ jm&icoce. The kiyentkm 

t«xt infiMnadoD (eg,, subtirlea.)L Tbe tovexotai also allows waom^ and subsequent 
retrieval and review of Km lacluded tvjihin the dosed caption {s^fiMicatSon, iwhiclx text $arve« 
03 a uanscripc of the program. The iDel]u)d6 azkd as^aratus provided are bidepenckns of die 
lype of deBvery oetwork, ccntani fontn&r» asd lecehi^ type. Id an exaraple embodtmenti 
oiosftd caption inloiiiiaiioo is axudCttd (^g., by a closed caption pcocaasor 20) ftom a 
tdevteioo algsal 10» «4ucii tetcvlsioa sigtial 10 dso eomdiaa comapoofiog eodipviaual 
ptogsmmlAg. Iht proeeayor 20dctccnBU2c$ ^^iMicr ooe or moia user selected aUribmea 12 
b9vc been set. Ai le&st ooe user relecttd attribute 12 bapptiadtoaHeasinportioaoif lh» 
closed caption infoiniatioii («.g.» via a closed capiioo driver 3<Q, The closed caption 
infonnaliQD la duplayed (<.g.» via a ciapiay driver 40 and graphic proocssar 45} on a display 
device 50 (e^ a tslevbioii screen} iriacooidanoe with tl^ 12 viaa 

geaphical overlay on top of thaaodiovisuaS progrsuuDinfl. In this man2»r, user setected 
advadoed cloaed capiion feattves can be provided using axlatisg olossd csfi^xm inTesinalsoa 
coQSained in tbe television aignsi 
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